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Abstract 

In this paper we describe a methodology for determining corrections to 
parameters and initial conditions in order to improve model forecasts in the 
presence of data. This methodology is grounded in the variational problem 
of minimizing the norm of the errors between forecast and data. The general 
method is presented, and then the method is applied to the specific example 
of a scalar model, the logistic equation, where it is shown that the method 
produces satisfactory results. 
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1 Introduction 



Models are abstractions of reality and the goodness of a model is often judged by its 
ability to explain the observations which are the reflections of the underlying reality. 
The difference between the actual observation and the model counterpart of the ob- 
servation is known as the prediction error or forecast bias. This error/bias is a result 
of either an "inadequate" model or a result of misspecifications of initial/boundary 
conditions and/or parameters in the model. Recently, Lakshmivarahan and Lewis 
(2008) (LL(2008), hereafter) have developed a framework for estimating the error 
in initial/boundary conditions and/or parameters that will account for the observed 
forecast bias. Using the (first-order) sensitivity of the solution with respect to the 
initial conditions and parameters and the observed forecast errors, this framework 
recasts the bias estimation problem as an inverse problem, in particular as a lin- 
ear least-squares problem. In LL(2008), they demonstrated the power of this idea 
using a simplified model consisting of a system of three coupled nonlinear ordinary 
differential equations that describes the evolution of the mixed-layer over the Gulf 
of Mexico and actual observations obtained from an earlier field experiment. For 
details, refer to LL(2008) and references therein. 

In this paper we further analyze the power of this framework using a scalar model 
for population growth known as the logistic model in continuous time. But instead of 
the first-order method used in LL(2008), in this paper we compare the performance 
of first-order and second-order methods. For simplicity it is assumed that the model 
is adequate and the forecast errors are due only to errors in the initial condition 
and the parameter. As will become evident, the first-order method leads to a linear 
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least-squares problem and the second-order method leads to a nonlinear least-squares 
problem. Analysis of model inadequacies will be explored in a companion paper. 

Section 2 contains a summary of the framework and is adapted from LL(2008). 
Properties of the logistic model are described in Section 3. Numerical experiments 
related to the estimation of errors using the first-order and second-order methods 
along with a comparison of these methods are contained in Section 4. Concluding 
observations are contained in Section 5. 

2 The Framework - a Summary 

Let x(t) £ R denote the state of a dynamical system at time t £ R + where x(0) is 
called the initial state. Let / : RxRxR + — > R and the state evolve according to a 
scalar nonlinear ordinary differential equation given by 



where a £ R is called the parameter. It is tacitly assumed that the function / in (12. ip 
satisfies all of the conditions required for the existence, uniqueness, and smoothness 
of the solution x(t) = x(t, a, x(0)) for all t £ R + . 

Let h : R — > R be a smooth function that defines the model counterpart of the 
observation 



x = f(x, a, t) 



(2.1) 



Z 



M 



h(x(t)) 



(2.2) 
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Let Zt be the actual observation obtained from the field measurement. Then 

e t = z t - zf (2.3) 

denotes the prediction error or the forecast bias. It is assumed that the model 
in (12. ip does not have any deficiencies and the forecast bias is mainly due to the 
misspecification of the initial condition, x(0), and/or the parameter a. 

Let Ax be the actual change in x(t) induced by the perturbations 5x(0) in x(0) 
and 5a in a. The goal is to find j3 = (5x(0), Sa) T , the vector of perturbations such 
that 

z t - h(x t + Ax) = 0. (2.4) 
Let Ah be the actual change in h(x(t)) induced by the change Ax in x(t). Then 

h{x(t) + Ax) = h(x(t)) + Ah (2.5) 

Combining ( 12. 3 p - 02 .5p . our goal is to find (3 such that 

e t = Ah (2.6) 

Recall that 

oo 

Ah = J2$ J h (2.7) 
where 5^h is called the fh variation of h, the fraction of the induced change that is 
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attributable to the j derivative of h and the change in Ax in x(t). Similarly 



where S^x, called the j th variation of x, is the fraction of the total change in x(t) 
that is attributable to the j partial derivatives of x(t) with respect to a and x(0) 
and /3. 

In practice we approximate the infinite sum by taking only the first k terms, 
resulting in a fc -order approximation given by 



OC 




(2.8) 



k 



k 




(2.9) 



2.1 First-order Approximation 



Setting k — 1, we get 



Ah = 5h and Ax = Sx. 



(2.10) 



Let D a (g) = From first principles and ( 12.101) . it follows that 



8h = D x (h)Ax = D x (h)5x 



(2.11) 



and 



5x = D x (ty(x)5x(0) + D a (x)5a. 



(2.12) 
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The first derivative D a (g) is called the first-order sensitivity of g with respect to a 
(Cacuci (2003) and Cruz(1973)). Setting 

Th = D x(0) (x), 7T 2 = D a (x),H = [#T, #2] G M lx2 , 

(12.12ft can be rewritten as 

5x = Hfi. (2.13) 

Combining (I2.13P and ( 12. lip with (12.61) we obtain an underdetermined linear least- 
squares problem 

Hf3 = e (2.14) 

where 

H = D x (h)H e M lx2 (2.15) 

Suppose that there are N observations z tl , z t2 , ... z tN available at times < ti < 
t 2 < ... < tjy. Then, at each time ti, 1 < i < N, we have the forecast error 

e u = z u -h(x u ) (2.16) 

Define 

H~x{U) = D xi0) {x{ti)), H~ 2 {U) = D a {x{U)) (2.17) 
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and a diagonal matrix 



D(h) = Dmg{D 1 (h),D 2 (h),...,D N (h)} G 



oTVxTV 



where 



Di(h) = D x {h{x{U))). 



for simplicity in notation. Let 



H 



N 



H[{t x ) TT 2 {t x ) 



Hx(t N ) H 2 {t 



N 



>Nx2 



H N = D(h)H, 



N 



and 



E N = (e tl ,e t2 , ...,e tjv ) T G 



(2.11 



(2.19) 



(2.20) 



For this case of iV observations, in place of (I2.14p . we obtain a linear least-squares 
problem 

H N (3 = E N (2.21) 

where H N G R Nx2 , j3 G M 2 , and E N eR N . 
The unknown (3 is obtained by minimizing 



9l (f3) = \\H N p-E. 



N 



(2.22) 
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where it is tacitly assumed that the matrix is of full rank. Under this assumption, 
/3 is given by (Lewis, et al (2006)) 



(H T N H N ) 1 HjjE N if iV > 2 
H^En if iV = 2 

H T N (H N H J N y l E N if AT < 2 



(2.23) 



When H N is not of full rank, we invoke the Tikhonov regularization (Lewis, et al 
(2006)) using which j3 is obtained by minimizing 



(2.24) 



for some real constant A > 0, called the regularization parameter. The minimizing 
(3 in this case is given by 



@ls = {HjjH N + XI) 1 hJ ! e n 



(2.25) 



In place of Tikhonov regularization, one could use the generalized inverse of the 
matrix Hn to obtain 

P = H+E N 

where is the Moore- Penrose inverse (Lewis et al (2006)). 



7 



2.2 Second-Order Approximation 

Setting k = 2, in (ESD, it follows that 



Ax = 5x + 5 2 x (2.26) 

where 5x is given by H2. 131) is linear in (5. From first principles, we obtain 

5 2 x = ^j3 r D 2 (x)/3 (2.27) 

which is quadratic in j3 and D 2 (x) is the Hessian of x(t) with respect to the entries 
of f3, that is 

D 2 (x) = 

where D 2 (g) = and D 2 b (g) = -§^- The second partial derivatives of g are also 
called the second-order sensitivities of g with respect to a and b. Similarly, from 

Ah = 5h + 5 2 h = D x {h)Ax + ^D 2 x {h){Ax) 2 (2.29) 

Substituting ( I2.26P in f |2.29|) and using (I2.6P for the case of the single observation, 
we obtain a nonlinear least-squares problem. 

e t = D x (h)(5x + 5 2 x) + ^D 2 x (h)(Sx + S 2 x) 2 (2.30) 



D 2 x{Q) {x{t)) 



x(t)) D 2 a (x(t)) 



(2.28) 
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The unknown j3 is then obtained by minimizing 



ffe(0) 



e t - D x (h)(8x + 5 2 x) + -D 2 x (h)(5x + 5 2 xf 



(2.31) 



In the special case where the state is directly observable, h(x) = x and so D x (h) = 1 
and D x (x) = 0. Substituting these into f!2.3ip . in view of (I2.13P and (12.17j) . we get 



ft. 08) 



et-H/3- ^/3 T D 2 (x)/3 



(2.32) 



Clearly, ^(/8) is a fourth degree polynomial in the components of /3 and in general 
can have multiple minima which could further complicate the minimization problem. 
When there are N (> 2) observations at times < to < ^i < ' ' ' < ^jv-1j then we get 
N versions of the relation (12.301) . one for each time. The unknown f3 is then obtained 
by minimizing 



N-l 



8=0 



1 



e u - D x{u) (h)[5x(t t ) + 5 2 x(t t )} - ^-D 2 x(ti) (h)[5x(U) + 5 2 x(U)] 2 



(2.33) 



In the special case when h(x) = x, D x (h) = 1 and D 2 (x) = and fj2.33j) reduces to 



N-l 



G 2 (P) = £ 



i=0 



e u -H(t l )/3-^(3 T D 2 (x(t l )(3 



(2.34) 
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3 The Logistic Equation 

Consider the standard logistic equation that describes the growth of a certain popu- 
lation in an environment with carrying capacity 1 and growth rate parameter a > 
given by 

x = ax(l — x) (3.1) 

with x(0) = x a > as the initial condition. The solution of this nonlinear ordinary 
differential equation is given by 

a/t 

-L <Xj q I «A/ Q O 

Notice that x(t) depends nonlinearly on x Q and a. 

It can be verified that x(t) — > 1 as t — > oo and G [0, 1] for all t whenever 
x(0) G [0, 1], for a > 0. Since > for all t, and so is an increasing function 
which increases from x D to 1 as t increases from to oo. A typical plot of x(t) in 
(13. 2p for x(0) = 0.5 and a = 1 is given in Figure 1. 

The various first-order sensitivities of the the solution with respect to /3 — 
(x(0), a) T are given by 

e at 

D x(0)( x ) = T, , Z „„m ( 3 ' 3 ) 



[l-x + x Q e at } 2 

)te at 
[1 - x + x e at ] 2 



D a {x) = M - | ^ ^ m = x (l - Xo^D^q) [x] (3.4) 
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That is, D a (x) is a multiple of D x ^y Further it can be verified for large t that 



D a (x) « —te~ at and D x{0) (x) « -^e~ a ' 



Thus, D a (x) and hence Z? x (o)(a;) tend to zero as t — >■ oo. A plot of D a (t) and 
D x (o)( x ) versus t for x Q = 0.5 and a = 1 is given in Figure 2. This in turn implies 
that x(t) becomes less sensitive with respect to a and x(0) for large t, and that for 
our framework to be effective, the observations have to be taken during the transient 
phase of the solution. 

The Hessian of x(t) with respect to /3 whose elements are the second-order sen- 
sitivity functions are given by 



D\x) = 



D 2 m {x) Dl {Q) Jx) 
Dl M o)W D2 M 



(3.5) 



where 



and 



^x(O) ( X 



at „2at\ 



2 (e at - e 



Dl{x) 



[l-x + x e at f 

x (l-x )t 2 e at [l-x -x e at ] 
[l-x + x e at f 



D 2 (r\ - D 2 (r\ - [ — — J 

^x(0),a{ X > ~ ^a,x(0)W ~ [1 _ Xq + Xo e at f ' 

It is assumed that x(t) is directly observable, and so h(x) = x. Accordingly D x (h) 
1 and D 2 x {h) = 0. 
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3.1 The First-Order Approximation 

In this case (12. 14ft reduces to (12. 13ft and from (13.31) and (13.4|) we get 



H = H = D x{0) (x)[l,x {l - x )t] e 



)lx2 



(3.6) 



Two cases arise. The first case is when there are less observations than parameters. 
The second is when the number of observations is at least as great as the number 
of unknown parameters. In this paper, we only address the latter case. In this case, 
N > 1 and 

D x ( 0) Ab( ) (x(ti))x (l - X )ti 
D x (o){x{t 2 )) D x(0) (x(t 2 ))x o (l -x Q )t 2 



H 



N 



(3.7) 



D x (p)(x(t N )) D x( Q)(x{t N ))x (l - x )t N 

It can be verified that matrix G M. Nx2 is of rank two and the least-square solution 
is given by 

H^En if N = 2 

(HlH N )- 1 Hj f E N tfN>2 



Pis 



(3. 



3.2 The Second-Order Approximation 



Expanding the right hand side of (12.341) and dropping the terms of degree 3 and 4, 
we obtain a quadratic approximation Q(/3) to g 2 (/3) given by 



N-l 



W) = E K - 2e tMti)P + P T [H(ti) T H(U) - e ti D 2 (x(t ? 



(3.9) 



i=0 
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The f3 that minimizes this is given by 

jV-1 

Pis = E [H(U) T H(U) - e ti D\x{U))] H(U) T e u . (3.10) 

4 Numerical Experiments 

In this section we compare the performance of the first-order and the second-order 
methods using N (> 2) observations. 

4.1 Generation of Observations 

It is assumed that h(x) = x, that is, the state of the system x(t) is directly observable 
and that z t = x(t). We use the model solution x(t) starting from x(0) and a to 
generate different sets of N observations. 

The distribution of the observation times 

to < ti < < ■ • • < ijv— i 

are given in Table 1 where tj = to + i(kA) with A = 0.5 (fixed), k — 1, 4, 8 and 
12 and < i < N — 1. Here to denotes the starting time and (kA) denotes the 
time between successive observations. Thus, for example, for to = and k = 4, we 
generate N = 6 observations at times to = 0.0, ti = 2.0, £2 = 4.0, £3 = 6.0, £4 = 8.0, 
and £5 = 10.0, which corresponds to the second row of Table 1. 

The actual observations z ti = x{t,j) where x(ti) is the solution of (13. ip starting 
from x(0) = 0.5 and a = 1.0 used in the estimation of j3 are given in Table 2. 

13 



4.2 A Plan for the Experiment 

Let x(t) be the solution of the model (13. lft starting from x(0) 7^ x(0) and a^a. Our 
goal is to estimate Sx(0) = x(0) — x(0) and 5a = a — a using the set of observations 
in Table 2. We divide the experiment into three parts based on N, the number of 
observations. 

Case 1 : N = 2. We compute the estimates of (5 using two observations at times to 
and to + kA for k — 1, 4, 8 and 12 and for to = 0, 4 and 8. Estimates of (3 using the 
first-order and the second-order methods are given in the top part of Tables 3 and 4 
respectively. 

For example, referring to the top part of Table 3, the estimate of /3 = (5x(0) 5a) 
using two observations z to = z 4 = x(4) and z tl = z 4 . 5 = x(4.5) and the first-order 
method is given by j3 = (—0.0955,0.0981). Since the actual value of Sx(0) = —0.1 
and 5a = 0.1, the relative error in the estimate of 5x(0) = om5 5-(~o.i) _ g g^g 
and that of 5a = a09 ^~ ai = -0.019. Similarly for all other patterns of iV = 2 
observations. 

Case 2 : N = 4. Results of the estimation of /3 using 4 observations at times to, 
to + kA, to + 2kA and to + 3kA for k — 1, 4, 8 and 12 and to = 0, 4 and 8 are given 
in the middle parts of Tables 3 and 4. 

Case 3 : N = 6. Results of the estimation of f3 using 4 observations at times t , 
t + kA, t + 2kA, to + 5kA for k = 1, 4, 8 and 12 and t = 0, 4 and 8 are given 
in the bottom parts of Tables 3 and 4. 
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4.3 Comments and Discussion 

A number of observations are in order. 

1. When two observations are too close to each other, say by a distance A = 0.5, 
the solutions at these two times are very close to each other and consequently 
the sensitivity functions at time to (D x ^(x(t )), D a (x(t ))) and at time ti = 
t + A namely (D x ( ){x{ti)), D a (x(ti))) are also very close to each other. This 
in turn implies that the two rows in are very nearly colinear, which leads 
to bad conditioning of the matrix Hn- Hence there is a greater chance for 
the estimates to be less reliable. 

2. From (I3.2p and Figure 1, it follows that the solution x(t) attains the steady state 
value which is independent of x(0) and a. In other words, the sensitivity of x(t) 
with respect to x(0) and a decrease to zero as t increases. Thus, from (13. 3ft and 
( 13. 41) it follows that D x (o){%{t)) and D a (x(t)) both tend to zero as t increases. 
Thus, the row of for large t becomes zero leading to ill-conditioning of H ^ 
which makes the estimates less reliable. 

3. Since the solution x(t) depends on x(0) and a nonlinearly, we cannot hope to 
recover the actual perturbations 5x and 5a that led to the forecast bias in 
the first place. While in principle the second-order method is better than the 
first-order counterpart, to improve the overall accuracy of the estimate, one 
may have to resort to an iterative improvement of the estimate. A detailed 
comparison of the performance of the iterative versions of the first and second 
order methods for small values of the perturbations (5xo = —0.1 and 5a = 0.1) 
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are given in Tables 5 and 6 respectively. Tables 7 and 8 contain similar results 
for large values of 5x and 5a. 

It turns out that the iterative versions of the first-order method peform at least 
as well as the iterative versions of the second-order counterpart. Given that 
second-order methods require larger computation, from this exercise it follows 
that the iterative first-order method would be a good choice for estimating the 
forecast bias. 
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Figure 1: Typical Solution of Logistic Equation (x(0) = 0.5 and a = 1) 
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Figure 2: First-Order Sensitivities of the Solution to the Logistic Equation 
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Table 1: Distribution of the iV observation times: ti = t + k{i — 1)A with A = 0.5, 
k — 1, 4, 8, and 12 and < % < N — 1. t denotes the starting time and kA denotes 
the time interval between successive observations and N denotes the number of 
observations. 
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0.99999999999931 


1.00000000000000 



Table 2: Actual Observations 



21 



True Corrections 


5x = 


-0.1 


5a = 


0.1 


2 observations 




multiple of A 




t 


1 


4 


8 


12 


5x Q 


-0.1000 


-0.1000 


-0.1000 


-0.1000 


5a 


0.0761 


0.0968 


0.1028 


0.0989 


K 


2.8e+2 


4.1e+l 


2.0e+2 


3.1e+3 


4 5x a 


-0.0955 


-0.0888 


-0.0809 


-0.0739 


5a 


0.0981 


0.0912 


0.0829 


0.0756 


K 


1.3e+3 


6.0e+2 


5.0e+3 


8.1e+4 


8 5x Q 


-0.0479 


-0.0390 


-0.0284 


-0.0190 


5a 


0.0657 


0.0611 


0.0555 


0.0507 


K 


7.9e+3 


3.8e+3 


3.2e+4 


5.2e+5 


4 observations 




multiple of A 




to 


1 


4 


8 


12 


5x Q 


-0.1006 


-0.1000 


-0.1000 


-0.1000 


5a 


0.0892 


0.0977 


0.1028 


0.0989 


K 


7.0e+l 


3.5e+l 


2.0e+2 


3.1e+3 


4 5x Q 


-0.1038 


-0.1108 


-0.1477 


0.4009 


5a 


0.0977 


0.1039 


0.1349 


-0.0570 


K 


3.9e+2 


9.4e+2 


5.0e+4 


1.5e+5 


8 5x Q 


-0.0440 


-0.0378 


-0.0283 


-0.0190 


5a 


0.0637 


0.0605 


0.0555 


0.0507 


K 


2.5e+3 


3.4e+3 


3.2e+4 


5.2e+5 


6 observations 




multiple of A 




t 


1 


4 


8 


12 


5x 


-0.1011 


-0.1000 


-0.1000 


-0.1000 


5a 


0.0951 


0.0977 


0.1028 


0.0989 


/t 


4.2e+l 


3.5e+l 


2.0e+2 


3.1e+3 


4 5x Q 


-0.0907 


-0.0879 


-0.0808 


-0.0739 




0.0932 


0.0902 


0.0828 


0.0756 




3.0e+2 


5.4e+2 


5.0e+3 


8.1e+4 


8 5x 


-0.0416 


-0.0378 


-0.0283 


-0.0190 


5a 


0.0625 


0.0605 


0.0555 


0.0507 


K 


1.8e+3 


3.4e+3 


3.2e+4 


5.2e+5 



Table 3: Estimates of (3 using the first-order method, k denotes the condition number 
of the matrix H N Hjy, where iV is the number of observations used in the estimation. 
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True Corrections 


5x Q = 


-0.1 


5a = 


0.1 


2 observations 




multiple of A 




to 


1 


4 


8 


12 


5x Q 


-0.1000 


-0.1000 


-0.1000 


-0.1000 


5a 


0.1117 


0.0987 


0.0945 


0.0980 


K 


2.1e+2 


2.5e+l 


1.8e+2 


7.1e+3 


4 Sx 


n 1 nnn 
-U.lUUy 


-0.1098 


-0.1489 


n 1 ok/1 
-U.1Z04 


5a 


U.Uyoo 


0.1030 


0.1359 


U. 124 1 


K 


1 1 « i o 

l.le+3 


9.6e+2 


5.1e+4 


2.5e+5 


8 5x Q 


0.3763 


0.3744 


0.3737 


0.3749 


5a 


-U.UOzo 


-0.0523 


-0.0521 


-U.U024 


K 


8.2e+3 


4.7e+3 


5.2e+4 


l.le+o 


4 observations 




multiple of A 




to 


1 


4 


8 


12 


5x 


-0.0995 


-0.1000 


-0.1000 


-0.1000 


5a 


0.1025 


0.0983 


0.0945 


0.0980 


K 


5.4e+l 


2.3e+l 


1.8e+2 


7.1e+3 


A £™ 

4 0X o 


n 1 noo 


-0.1108 


-0.1477 


n a nnn 
U.4UUy 


5a 


u.uy / / 


0.1039 


0.1349 


n ncvn 
-U.UO ( U 


K 


o n~ i o 

3.9e+2 


9.4e+2 


5.0e+4 


1.5e+5 


8 5x 


0.3754 


0.3743 


0.3737 


0.3749 


5a 


-U.Uozo 


-0.0523 


-0.0521 


n nco/i 
-U.U0Z4 


K 


2.oe+3 


4.3e+3 


5.2e+4 


1 i « i c 

l.le+o 


6 observations 




multiple of A 




to 


1 


4 


8 


12 


<5x 


-0.0991 


-0.1000 


-0.1000 


-0.1000 




0.0991 


0.0983 


0.0945 


0.0980 


K 


3.3e+l 


2.3e+l 


1.8e+2 


7.1e+3 


4 <5x 


-0.1059 


-0.1108 


-0.1477 


0.4009 




0.0995 


0.1039 


0.1349 


-0.0570 




3.0e+2 


9.4e+2 


5.0e+4 


1.5e+5 


8 5x 


0.3750 


0.3743 


0.3737 


0.3749 


5a 


-0.0524 


-0.0523 


-0.0521 


-0.0524 


K 


1.9e+3 


4.3e+3 


5.2e+4 


l.le+6 



Table 4: Estimates of /3 using the second-order method, k denotes the condition 
number of the matrix H N Hjy, where N is the number of observations used in the 
estimation. 
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True Corrections 


5x a 


-0.1 


5a = 


0.1 


2 observations 




multiple 


i of A 




to 


1 


4 


8 


12 


5x 


-0.1000 


-0.1000 


-0.1000 


-0.1000 


5a 


0.1000 


0.1000 


0.1000 


0.1000 


K 


2.6c+2 


3.2e+l 


2.0c+2 


4.6e+3 


iterations 


4 


4 


4 


4 


4 Sx 


-0.1000 


-0.1000 


-0.1000 


-0.1000 


5a 


0.1000 


0.1000 


0.1000 


0.1000 


K 


1.4e+3 


8.7c+2 


l.lc+4 


2.7c+5 


iterations 


4 


4 


4 


5 


8 5xq 


-0.1000 


-0.1000 


-0.1000 


-0.1000 


5a 


0.1000 


0.1000 


0.1000 


0.1000 


K 


8.6c+3 


5.7c+3 


7.5e+4 


1.8c+6 


iterations 


5 


5 


5 


5 


4 observations 




multipk 


3 of A 




to 


1 


4 


8 


12 


5x 


-0.1000 


-0.1000 


-0.1000 


-0.1000 


5a 


0.1000 


0.1000 


0.1000 


0.1000 


K 


6.3c+l 


2.9e+l 


2.0c+2 


4.6e+3 


iterations 


4 


4 


4 


4 


4 5x 


-0.1000 


-0.1000 


-0.1000 


-0.1000 


5a 


0.1000 


0.1000 


0.1000 


0.1000 


K 


4.6c+2 


8.1c+2 


l.lc+4 


2.7c+5 


iterations 


4 


4 


4 


5 


8 5x 


-0.1000 


-0.1000 


-0.1000 


-0.1000 


5a 


0.1000 


0.1000 


0.1000 


0.1000 


K 


2.9e+3 


5.3e+3 


7.4c+4 


1.8c+6 


iterations 


5 


5 


5 


5 


6 observations 




multipk 


3 of A 




to 


1 


4 


8 


12 


5xq 


-0.1000 


-0.1000 


-0.1000 


-0.1000 


5a 


0.1000 


0.1000 


0.1000 


0.1000 


K 


3.9e+l 


2.9e+l 


2.0c+2 


4.6e+3 


iterations 


4 


4 


4 


4 


5x 


-0.1000 


-0.1000 


-0.1000 


-0.1000 


5a 


0.1000 


0.1000 


0.1000 


0.1000 


K 


3.5c+2 


8.1c+2 


l.lc+4 


2.7c+5 


iterations 


4 


4 


4 


5 


8 5xo 


-0.1000 


-0.1000 


-0.1000 


-0.1000 


5a 


0.1000 


0.1000 


0.1000 


0.1000 


K 


2.2c+3 


5.3e+3 


7.4e+4 


1.8c+6 


iterations 


5 


5 


5 


5 



Table 5: Estimates of /? using the iterated first-order method, n denotes the condition number of 
the matrix H n Hn, where N is the number of observations used in the estimation. The number of 
iterations is that required to reach a threshold of 10~6 (at most 10) 
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True Corrections 


5x a = 


-0.1 


5a 


= 0.1 


2 observations 




multipl 


c of A 




to 


1 


4 


8 


12 


5xo 


-0.1000 


-0.1000 


-0.1000 


-0.1000 


5a 


0.1000 


0.1000 


0.1000 


0.1000 


K 


2.6e+2 


3.2e+l 


2.0c+2 


4.6e+3 


iterations 


4 


4 


4 


4 


4 Sx 


-0.1000 


-0.1000 


-0.1000 


-0.1000 


5a 


0.1000 


0.1000 


0.1000 


0.1000 


K 


1.4e+3 


8.7c+2 


l.le+4 


2.7c+5 


iterations 


4 


4 


5 


6 


8 Sxo 


-0.1000 


-0.1000 


-0.1000 


NaN 


5a 


0.1000 


0.1000 


0.1000 


NaN 


K 


8.6e+3 


5.7c+3 


7.5c+4 


1.0e+9 


iterations 


6 


5 


5 


10 


4 observations 




multipl 


c of A 




to 


1 


4 


8 


12 


5xo 


-0.1000 


-0.1000 


-0.1000 


-0.1000 


5a 


0.1000 


0.1000 


0.1000 


0.1000 


K 


6.3e+l 


2.9e+l 


2.0c+2 


4.6c+3 


iterations 


4 


4 


4 


4 


4 5xo 


-0.1000 


-0.1000 


-0.1000 


-0.0868 


5a 


0.1000 


0.1000 


0.1000 


0.1023 


K 


4.6c+2 


8.1c+2 


l.le+4 


2.4c+5 


iterations 


4 


4 


5 


10 


8 5xo 


-0.1000 


-0.1000 


-0.1000 


-0.1000 


5a 


0.1000 


0.1000 


0.1000 


0.1000 


K 


2.9e+3 


5.3c+3 


7.4c+4 


1.8e+6 


iterations 


7 


7 


6 


6 


6 observations 




multipl 


c of A 




to 


1 


4 


8 


12 


5x 


-0.1000 


-0.1000 


-0.1000 


-0.1000 


5a 


0.1000 


0.1000 


0.1000 


0.1000 


K 


3.9e+l 


2.9e+l 


2.0c+2 


4.6e+3 


iterations 


3 


4 


4 


4 


4 5x 


-0.1000 


-0.1000 


-0.1000 


NaN 


6a 


0.1000 


0.1000 


0.1000 


NaN 


K 


3.5c+2 


8.1c+2 


l.le+4 


1.0e+12 


iterations 


4 


4 


5 


10 


8 Sxo 


-0.1000 


-0.1000 


-0.1000 


NaN 


6a 


0.1000 


0.1000 


0.1000 


NaN 


K 


2.2c+3 


5.3e+3 


7.4c+4 


7.2e+12 


iterations 


7 


7 


6 


10 



Table 6: Estimates of j3 using the iterated second-order method, k denotes the condition number 
of the matrix H n Hn, where N is the number of observations used in the estimation. The number 
of iterations is that required to reach a threshold of 10^6 (at most 10) 
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True Parameter Values: 


x D — 0.5, 


a = 1.0 


Model Values 


Corrections 


to 


Xq 


a 


5xo 


5a 


Iterations 





0.3 


0.8 


0.2000 


0.2000 


5 




0.3 


0.9 


0.2000 


0.1000 


5 




0.3 


1.1 


0.2000 


-0.1000 


5 




0.3 


1.2 


0.2000 


-0.2000 


5 




0.4 


0.8 


0.1000 


0.2000 


5 




0.4 


1.1 


0.1000 


-0.1000 


4 




0.4 


0.9 


0.1000 


0.1000 


4 




0.4 


1.2 


0.1000 


-0.2000 


4 




0.6 


0.8 


-0.1000 


0.2000 


4 




0.6 


0.9 


-0.1000 


0.1000 


4 




0.6 


1.1 


-0.1000 


-0.1000 


5 




0.6 


1.2 


-0.1000 


-0.2000 


5 




0.7 


0.8 


-0.2000 


0.2000 


4 




0.7 


0.9 


-0.2000 


0.1000 


5 




0.7 


1.1 


-0.2000 


-0.1000 


5 




0.7 


1.2 


-0.2000 


-0.2000 


5 


4 


0.3 


0.8 


0.2000 


0.2000 


7 




0.3 


0.9 


0.2000 


0.1000 


6 




0.3 


1.1 


0.2000 


-0.1000 


5 




0.3 


1.2 


0.2000 


-0.2000 


5 




0.4 


1.1 


0.1000 


-0.1000 


4 




0.4 


1.2 


0.1000 


-0.2000 


5 




0.4 


0.8 


0.1000 


0.2000 


6 




0.4 


0.9 


0.1000 


0.1000 


5 




0.6 


0.8 


-0.1000 


0.2000 


5 




0.6 


0.9 


-0.1000 


0.1000 


4 




0.6 


1.1 


-0.1000 


-0.1000 


6 




0.6 


1.2 


-0.1000 


-0.2000 


8 




0.7 


0.8 


-0.2000 


0.2000 


5 




0.7 


0.9 


-0.2000 


0.1000 


5 




0.7 


1.1 


-0.2000 


-0.1000 


7 




0.7 


1.2 


-0.2000 


-0.2000 


10 


8 


0.3 


0.8 


0.2000 


0.2000 


7 




0.3 


1.1 


0.2000 


-0.1000 


5 




0.3 


0.9 


0.2000 


0.1000 


7 




0.3 


1.2 


0.2000 


-0.2000 


7 




0.4 


0.8 


0.1000 


0.2000 


7 




0.4 


0.9 


0.1000 


0.1000 


6 




0.4 


1.1 


0.1000 


-0.1000 


5 




0.4 


1.2 


0.1000 


-0.2000 


11 




0.6 


0.8 


-0.1000 


0.2000 


6 




0.6 


1.1 


-0.1000 


-0.1000 


6 




0.6 


1.2 


NaN 


NaN 


100 




0.6 


0.9 


-0.1000 


0.1000 


5 




0.7 


1.1 


-0.2000 


-0.1000 


9 




0.7 


1.2 


NaN 


NaN 


100 




0.7 


0.8 


-0.2000 


0.2000 


6 




0.7 


0.9 


-0.2000 


0.1000 


5 



Table 7: Iterated First-Order Corrections Using Different Model Parameters a and 
Initial Conditions x , in all cases using 4 observations spaced 0.5 seconds apart. 
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True Parameter Values: 


x D — 0.5, 


a = 1.0 


Model Values 


Corrections 


to 


Xq 


a 


5xo 


5a 


Iterations 





0.3 


0.8 


0.2000 


0.2000 


5 




0.3 


0.9 


0.2000 


0.1000 


5 




0.3 


1.1 


0.2000 


-0.1000 


5 




0.3 


1.2 


0.2000 


-0.2000 


5 




0.4 


0.8 


0.1000 


0.2000 


5 




0.4 


0.9 


0.1000 


0.1000 


5 




0.4 


1.1 


0.1000 


-0.1000 


4 




0.4 


1.2 


0.1000 


-0.2000 


4 




0.6 


0.8 


-0.1000 


0.2000 


4 




0.6 


0.9 


-0.1000 


0.1000 


4 




0.6 


1.1 


-0.1000 


-0.1000 


4 




0.6 


1.2 


-0.1000 


-0.2000 


4 




0.7 


0.8 


-0.2000 


0.2000 


4 




0.7 


0.9 


-0.2000 


0.1000 


4 




0.7 


1.1 


-0.2000 


-0.1000 


5 




0.7 


1.2 


-0.2000 


-0.2000 


5 


4 


0.3 


0.8 


NaN 


NaN 


101 




0.3 


0.9 


0.2000 


0.1000 


5 




0.3 


1.1 


0.2000 


-0.1000 


5 




0.3 


1.2 


0.2000 


-0.2000 


7 




0.4 


0.8 


0.1000 


0.2000 


7 




0.4 


0.9 


NaN 


NaN 


100 




0.4 


1.1 


0.1000 


-0.1000 


4 




0.4 


1.2 


0.1000 


-0.2000 


5 




0.6 


0.8 


-0.1000 


0.2000 


7 




0.6 


0.9 


-0.1000 


0.1000 


4 




0.6 


1.1 


-0.1000 


-0.1000 


5 




0.6 


1.2 


-0.1000 


-0.2000 


5 




0.7 


0.8 


-0.2000 


0.2000 


5 




0.7 


0.9 


-0.2000 


0.1000 


4 




0.7 


1.1 


-0.2000 


-0.1000 


5 




0.7 


1.2 


-0.2000 


-0.2000 


5 


8 


0.3 


0.8 


NaN 


NaN 


100 




0.3 


1.1 


0.2000 


-0.1000 


6 




0.3 


1.2 


0.2000 


-0.2000 


5 




0.3 


0.9 


0.2000 


0.1000 


16 




0.4 


0.8 


NaN 


NaN 


100 




0.4 


0.9 


NaN 


NaN 


100 




0.4 


1.1 


0.1000 


-0.1000 


5 




0.4 


1.2 


0.1000 


-0.2000 


4 




0.6 


0.8 


NaN 


NaN 


100 




0.6 


0.9 


-0.1000 


0.1000 


7 




0.6 


1.1 


-0.1000 


-0.1000 


5 




0.6 


1.2 


-0.1000 


-0.2000 


6 




0.7 


0.8 


-0.2000 


0.2000 


12 




0.7 


0.9 


-0.2000 


0.1000 


5 




0.7 


1.1 


-0.2000 


-0.1000 


5 




0.7 


1.2 


-0.2000 


-0.2000 


9 



Table 8: Iterated Second-Order Corrections Using Different Model Parameters a and 
Initial Conditions x , in all cases using 4 observations spaced 0.5 seconds apart. 



